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An audio signal in a hearing aid is enhanced by detecting the power of the desired audio signal and the power of the total audio 
signal, generating a power value and making a noise-reduction adjustment or no noise-reduction adjustment based on the power value. In 
one embodiment, the power value is a function of the total power of the audio signal. In a second embodiment the power value is a function 
of the ratio of the power of the desired audio signal to the power of the total audio signal. When the noise reduction is accomplished with 
beamforming, the invention uses a direction estimate vector in combination with a beam intensity vector, which is based on the power 
value, to generate a beamforming gain vector. The direction estimate vector is scaled by the beam intensity vector, the product of the 
vectors is the beamforming gain vector. Hie beamforming gain vector is multiplied with the left and right signal frequency domain vectors 
to produce noise reduced left and right signal frequency domain vectors. 
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DYNAMIC INTENSITY BEAMFORMING SYSTEM 
FOR NOISE REDUCTION IN A BINAURAL HEARING AID 

CROSS REFEREN CE TO RELATED APPLICATIONS 

The present invention is related to commonly-assigned 
patent application entitled "Binaural Hearing Aid," Serial 
No, 08/12 3,499 filed September 17,1993. This application 
describes a binaural hearing system in which the present 
invention could be used. The patent application is 
incorporated herein by reference. 

The present invention is also related to commonly- 
assigned patent application entitled "Noise Reduction 
System For Binaural Hearing Aid," Serial No. 08/123,5 : >, 
filed September 17, 1993. This application is directed to 
a noise reduction system that is an alternative to the 
noise reduction system in the present invention. Either 
noise reduction system can be used the "Binaural Hearing 
Aid" invention cited above. 



BACKGROUND OF THE INVENTION 



.^ Field of ...the Inventions 
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. , . , s ??* is invention relates to binaural hearing aids, and 
more particularly, to a noise reduction system for. use in 
a. binaural hearing aid,.., ...... :J 



Description of Prior Art: 




25 



reduction, as /applied to hearing aids, means 
? " v 't:h"e ."attenuation of undesitled signals and the amplification 
of' ; desired signals. Desired signals are usually speech 
theft , the hearing aid u^e^is trrying to understand. 
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Uiidesited iii^nals can be any sounds in the environment 
which interfere* V'it^i" the' principal speaker. 'These 
* uri&esired sounds' can bfe other speakers, restaurant 
" clatter, music, traffic noise, etc. There have been three 
5' m^in areas of ~ research ifi ' noise deduction as applied to 

hearing aids": Directional beamf'orniin*g f Spectral 

"subtraction , pltciii -based speech enhancement . 

: " ' 1 The purpose of be'a^oritiing in a hearing ^aid is to 
create an illusion" of T ;M tiirihel' hearing" iii which "the 

10 " listener hears 1 what" he^ is looking at, "but does riot hear 
,}i sounds wliich r are cbming from other directions. If he 

loolcs ih the direction 6f' a 'desired sound ™ e.g., someone 
he is speaking to — then bt her distracting sounds — 
e.g., other speakers — will be attenuated: A beamf ofmer 

15 then separates the desired "online" (line of sight) target 
signal from the unde sired '"%f f-lihe" " jammer signals so 
that the' target cafn be dkplif ie^l' whiie v "the* janiiner is 
attenuated'. "' " ** J ' ' '° ~' ; " 

Researchers have "attempted to use beamf ormihg to 

20 improve signal-to-iioise ratio' for hearing aids for a 

number of ytears (References "!, 2",' "3, " 5^" 5,' 7 J | * Three main 
approaches have 'beerf 'proposed/ *'Th : e simplest approach is 

' " to use purely analog dfer'ay-^ A more 

Sophisticated approach tises^ ^adaptive FIR"' xilt&r techniques 

25 using algorithinsy *su J ch r "a^ (1, 
3). These adapt! ver f *f il'ter ^techniques requite digital 
signal processihcf and Wei'e originally developed in the 
context of antenna array beamf ormihg for radar 
applications ( 4 ) V 'Sstiir "another" approach*" is~ iito'tivated v " 

30 from a model 1 of %lie J nimaff (8, 9). 

While * th r e ; iirst ^twb ^approaches ' are' time domkid Approaches , 
this last J approach i^ a frequency domain approach". 
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^There have been a „ number, of problems . associated with 
all of these approaches tp beamf oriping,. , The ^elay-and-sum 
and adaptive filter approaches have tended to break down 
in non-anechoic,. reverberant ...listening .situations; any 
-S real room will^Jhfltye. £p mapy aqpu^.tic, reflections ..coming 
off lfc vjrallp and c^iJ-ingp that, the adaptive filter s ,/will be 
largely unable tp disjting^i5,h. ; bjetye^n desirfd pounds 
coming from the front and undesired sounds coming from 
c other^^irectipn^ . , ., Th^ de^a^-and-sum and adaptive filter 
10 ^ techniques haye w dljso r ^^gjiire^ e^^Aj.ge (>=8). number of 
. ; ; microphone r sensor r s>. t£~ be. ^f^ectiye. . . This has ..made it 
^dif f icult.. jto; incorporate, thesjpt .systems , into 9 par^ctical 
heading aid. pa^J^grep... Oxip parage ,th^t ha? been proposed 
jppnsists. r pf.. a T microphpn^ array Qqrqss-. the top of 

■ :;l 5 ;r. ^gY&QiafPgS,.. i 2 ). . c , r r ; ... ... . r ... : , . . .. . l . . ... ^ ^ 

'•f. b * ' -» T ^-??r e « * r ^-- ? number of additional problems to the 

, bea^Jorming^ approach,, .to,, noi^p ^reduction that have not been 
solved by the above prior art beamf ormers . :;f the hearing 
aid wearer is trying to converse with more than one person 
20. at v a time^ such js v i^n f a ^inn|r or cocktail party situation 
c whejre, there are three or four people participating in the 
....... conversation, /then he jnust t tujrn his head quickly to look 

_ ^ .f i : r^t at 9p? z . speaker. ^hpjx^l^e^ext.. f< Jri addition, if he is 
:=:■■'-"" ; lc^qkicL|g at. pfi^ .^p^c^^r,. -^then tip may not be able to tell 
^.::?- 5 a:i^^ ie '5.j?;? e * r -. sp ??^.?:v JbBgun ^peaking since speakers other 
: . ..t±an r ;the r on?, he, lppHij^ Jt jare attenuated. Another 

. . disadvantage^ : to.^ typical bsa^f parting for noise reduction in 
t . hearing aids is the , unnatural, ^aimp^t^ claustrophobic effect 
which the hearing >t aid wpairer^experiences . It limits the 
3 £ e -^^Aef^lness of , b^a^ppning* r tp r ,particular ^high noise 

g ) sitxiatipng, ^ych. jas^ ^esta.u^a^t^ t and parties , where the 
., r ^^ 0 _,4iesire T tp communicate overshadows .concerns., of naturalness. 
Another problem T is „ audible, artifacts , , resembling a water 
fall or babbling brook, which are most noticeable at iow 
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signal lisvels when no" one ' is speaking, ^ or when there are 
* 4 no . significant * sound sources in the roonf other than 
background ambiance: fans, heaters, etc. 

: ' ; * r: ; : ;,: *" r; " " s tmMAR y " Of the invent i on 

5 It i s an object of " this invention to solve the above 

"" problems associated with signal discrimination devices 
such as beamf ormers'. ** 1 

" J * It is a further object of 'this invention "tb ires tor b 
1,1 " naturklness to the sound khd remove burbling' artifacts 
10 from the sound produced" by a "hearing aid. " 

In accordance with this invention, the above problems 
are solved by signal discrimiriation' apparatus detecting 
the power of a desireTd signal and the power of the total 
input signal, generating a power value from the detected 

15 power, and miking desired signal separation adjustment 
based on the power valued In one "embodiment," the power 
value is a function of the total power of the input 
signal. In a second embodiment / the power value is a 
function of the ratio of the power of the desired " signal 

2 0 to the power of the total input signal"/' ." 



The invention 1 We llective processes a Radiant " energy 
signal received by" a plurality "of sensors 1 or ieriteci in a 
predetermined viewing direction. A beamf ormer responsive 
to the" signals from the 'sensors separates online signals 

25 arriving at the sensors in a ^direction hear the viewing 
direction f rdm of f J lihe signals ^arriving' f rom other 
directions! M'ohitoring " operations monitor' all' o'f* the 
signals and determining a " combined strength f or" all 
signals and an online strength for the online signals. 

30 Thereafter, logicaf operatidhs responsive to the signal 
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strength enable, the beamformer when the signal strength is 
high and inhibit the beamformer when the signal strength 
is low. 

When the invention is applied to a binaural hearing 
5 aid with beamforming, the invention uses a direction 
r ^ estimate vector in combination with a beam intensity 

, vector r which , is based on the ppwer value, to, generate a 
beamforming gain vector. The direction estimate vector is 
scaled by the beam intensity vector; the product of the 
£.p,„. . vector^ i is the beamf opning cjain vector. The beamforming 
_ gain. vector is multiplied with the left and right signal 

frequency domain vectors to produce noise reducecj left and 
right signal frequency domain vectors . 

The beam intensity, vector describes, for each 
15 v . . frequency, how \ much the direction estimate will "affect the 
„ ^eamf ormin^ ' gain . If beam intensity equals one, then full 
^ direction, estimate, is applied and s.ignals coming from 

directions, other than. the_ ( loj>k\direction #> will be heavily 
attenuated. If beam intensity equals zero, then no 
direction estimate is applied, and the beamforming gain is 
.unity, regardless of direction of arrival. If beam 
intensity is., between zero, and one, then partial direction 
estimate is applied. The system is designed such that, 
. except for periods of transition, the, beam intensity is 
^^^ r .,9 n P-/ r ,.^}k\^ rke^f prming or .zero, no beamforming. 



20 
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The beam intensity vector may be implemented in Mode 
One operation as a function of the power of the sum of the 
..left and right, signal frequency domain vectors . This 
4 ^.,P?wer is^ measured in several subbands of the left and 
30 right- sum signal frequency "domain vector. The power in 

,_.^each subband deter^in.es the beam intensity in that 
- 6 ..^ ,,subband. ,If the input .signal flower is low, the beam 
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intensity is , low^ L and the .signal is allowed to pass 
. through unattenuated regardless of direction of arrival. 
If the^nput signal. pcwer ; - is . high/ the beam intensity is 
. . f .. ., high.,. ,;^nd direct ion ;i pf ^ arriva-X ;will have a large affect on 
5 , the beamforining ..g^in in that subband., ■. ^- 

. , ".^ r ,Th^ beam ^At^nsity sector is .implemented in Mode Two 

operation as a . f tjnctioiv :J of -a ,^atio. between ?^thet online 
power, of- the input signal-, -the.fpovrsr after beaanf orming, 
and the total power of j: t he ^/input : v aignaL / .-.:t:ii'e? power -before 

10 beamf orming. (Online power is the power of the input 

signal arriving >along thje, direction; ; of^ sic,htv )'" If this 
ratio is; Jiigh, indicating, consider-able . online power 
compared r to total power f :i^erir t;he:* . effects of i the • 
^ beamf o^ririing are. passed ^through , toe the: hearing- aid wbarer i 

15 , If this, ratio, is low-,- An<y,-c:aLting%:;littlo. online- power 
compared, with total power,.' then the affects- of the" 
beamf orming, are r edLuced^ ^ and, the,! original - signal- is 
allowed, to pass through ~ to^fe^echearirig" aid wearer. 

The result of : Mgde. ; One o^r cation is much the same as 
20 conventional beainf onner ?! r cexcept !that burbling artifacts, 
most noticeable at low -l^vel. inputs.^ at 
low levels . beam intensity , is 4ow 3:rrdb tehe're ^is 'little or no 
active beamf prming. ;/ The : r em^lt; o 4 f .•Mfede ; ;^^d-* : bpi s e¥a€ion is 
that sounds not cpming ^±r : pn< t&s ronllms ,1. o^ loc*^ "Hire ct ion 
25 are attenuated only t iff it^er^,;are .sounds ^ O'f-Vighi^f -leant 

power coming f ram, the^lpok rciirectioh. If ^the 'hearing aid 
wearer is looking directly at someone who is 'talking, then 
in Mode One or Mode Two all other sounds are attenuated. 
If the speaker pause,s : or BC i^ /the &eivJ•ing ^ '^ia : id■-%4a■^^er looks ' r * 
30 away, then in Mode -Two, all ispunds areddfeliveir«*d ^ ed 
unattenuated, . aiicj^ in : Mode One- only., the/* look dir&^ii&h 
sounds are unattenuated . even if there are no significant 
look direction sounds. If the hearing aid wearer is in a 
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conversation and is looking at a speaker and another 
person starts to speak, ' then-" if the first speaker pauses, 
the Mode Two operation will 7b top- beamf orming", and the 
hearing aid .wearer will hear the' other speaker; if the 
hearin g aid -wearer turns- to Uookin ' the L direction" of the 
new speaker, the beamf ormer will Become active again, ' : 
since there will once again be significant online energy. 
. - If there is a general pause' ±h -the Conversation, or if the 
heading -aid wearing -leaves -thte : ■ conve'r sation , then In Mode 
;-Two; operation the-wearer -wlfl^-^ost" ' iinraediateiy ' : ' 'hear all 
- >.~ . ^sounds- uiiattenuajted^'prlovi^ihg^^ natural sound '"field. 

->■ ■■■-- There, axevadjuielsam^ a1s&ck- r aa<i-feiease time r ' 

constants- associated with' -the- beam intensity vector and, 
therefore .with" the^. turning on-arid dff of "beamf orming. 
15 .These, time coristants-t applyt^fcd 'both Mode 6ne ; a*d 'tiode Two 

pperatipn.. - The rattacfc". *§Lto¥ constant is genefaily ^fast/ on 
the. order, of, tens^of aniftli-secS'nds (for example/ 2 0-3 Oms), 
while, .the* release:: time/ cbhstaht" ^ - generally' sTdw/ on the 
order of . a -few hundred: miiai-sec6rids (for example, : 5 00ms ) . 
The effect of the time constants is that, when there is a 
sudden increase in .fco&al power ^f or Mode One or of online 
.power relative to, -of f line, power •* or Mode : Two, then beam ' 
intensity ,v,ass.umi4ig. ar. fast attack, quickly goes up. If 
there r is the* * shoart . pause in" -power or online versus 
.offline ^n.exgy =feheri./; ass^aihd "a- slow release, the beam 
.An.ten.sdty will^tay,.high: £6^ % period corresponding to the 
release, fc-Anr©, atxd: ondy :then will?. It* -go low . This allows 
- for :: small . pauses inr speech Without- an intervening loss of 
beamf orming. ^- - : ..> -/.J/ - ... 
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s Other- advantages afca ^f-e acres' of the invention will 
be under.sto.od,- 1 by.tthos.e of bfenaiy skill in the art after 
referring to, the.icomplete written description of the 
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- -preferred eirib©aifrients ■ in' con junction witK "the" following 
.'-drawings-' • : '- — ' : - ; ' ; ~ 

I* 3 ' 7 : ' - BR-I : E:F DE&CRIj?frION OF THE DRAWINGS * ' 

rr.~ , -L , :piG . i- r -iiaustf at:^s : : *the preferred embodiment of the 
5 5 present" beamf of ^m'er "system for a binaural hearing' aid. 

: : 5. : :. ; fiG. 2 ! s-hows -trhfe -details of' the "inner product 

~ operation and-: the* sum of 4iiagnitudes squared dperation " 
•^ r: r -• ••- referred 1 to in operation- 113 and 114 'of r FlG; 

FIG. 3 shows the details of the beamf ormer gain 
..10 ' "'^'operation referted : to in- -operation 115' of Fl6. 1. 

F3"G. 4 shows 'the details of t:he" beam ^ iht ens ity 
"operation 316" bf rigv' '3 ; 0 ? ' r *' : ' * s '' ; c * ' 

FIG. 5* shows ^the'-^Kape'-bf' the r fufictit>n implemented by 
the "beam table bpelra-tlon ;: 404' of FldV 4 yJ " " K ' 

15 DESCRIPTION OF THE' ' PREFERRED j EMBODIMENTS * 

In FIG. 1, the be^inf orming System/ which" "is 
implemented as a DSP'* sof 'twarei' ! program, is sliowri as an 
operations flow diagram. The left and right ear 
" 1 ' ^microphone signals tt^r/^er keen? di^itizeci :> at the system 
20 sample rate F-^^-wh'icK 5 W'^i^ally ? ad Jiistabld in a range 
over 8 kHz - to 4 a : kHs, : but has a' nominal vilue bf °F M( ^ = 

sanp 

> 11.025 Khz for- the sampling- rate. ' The left and "right 
audio signals have 'littlev^or iio^ phas^ dr magnitude 
distortion. A hearing-aid systiiaiir for providing "siiidh low 
25 distortion left and -right" aiidio signals* is%es£i:£&ed in 
the above-ideiitii ied-crbss-ref efence'ci' patent" application 
entitled " Binaur^i 0 Hearing- Aid " * " The t'ime domain digital 
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input signal from, each .ear i$.. pa5SO(i. ; .to.. one— zero- pre- 
emphasis filters 101, 107. Pre-emphasis of lef t and 

right ear signals using a simple one-zero high-pass 
differentiator. _prer-white^s : ^he : signals before they are 
5 transformed to the frequency domain. This results in 
^reduced variance ^between ^ frequency coefficients so that 
, c ,^ here ar : e . f ewer Problems ^ith . niiia^ricaa error- , in* the 
Fourier transformation process. The effects of the 
p^eemphasis filter.s I01 hj yp ^a^e Removed after inverse 
10 iv: :^9 nr :^ er o traa ^ f °^£ tio £ ity ^ing one-pple integrator 

deemphasis filters 12 Q, -123, -qr^- the. left, and right signals 
at the end of beamforming processing. 

. Pp a ^P rT ^:^ ?P e ration in," FIG,..- 1 is performed /on M 
sample point blocks. The choice of M is a trade-off 
15 delay <in the system. It 

is also a function of the selected sample rate. For the 
nominal 11.025 sample rate, a value of M=256 has been 
■ ;\-£ U . $ ®^-* i , ^f^e^ore, :/ c^^S^^-ii 8 PJPpessed. in 256 point 

consecutive samplp flocks T After : each block is processed, 
20 the block origin is advanced by N=M/2 points. If the 

firs;t_blocfc spans - samples 0... :> 255 of both the left and * 
right channels, then the second block spans samples 
128 ,,-;.-383 # ^ the t^Lird spans . samples 256.. 511, etc. The 
f ,,Pr : ocessing of it eaplj . ^pp.secu^iyevblock is identical. 

25 ,^ _., v ^ The bea^|Qjinj.^g c pjc^qes^^ng begins., by. multiplying the 
left and right M. point; ■ .^aiople, b-iocks by a sine, window in 
operations. 105, 111. A, Fast Fourier Transform : (FFT) 
':? P ? r i?c f°- n 10 f 112 •; is c t ^?.Pe : ? formed qn the left and right 
-^SSS. i** 1 ^ ^ i 9? a l^.r. i real , this yields an N=M/2 
3 Pol i£?£ n ?r:: rej^en^ vectg^f pr both the left, and right 

ax bfH?4^:Sk^^ complex frequency 

^???5* rSt ^ f ?^? d :.t : 9::§s ^-frequency bin values (there 

lrJ:5 r r;:S* requenqy^r bins ; .,f rom^^F^p^. (rDC-) -to F=F samp /2 Khz ) 
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• - The irii^^^prbduct-bf -; and the sum of - Magnitude 
squares of each frequency bin for the left : and* right 
channel complex frequency vector, are used to obtain a 
, -measure of the? extent to : which the £ound £t that frequency 
-5 ^ ds .-online/ The inner product of / and the sum of magnitude 
squares of each frequency bin is calculated by operations 
113 and 114 , respectively. The expression for the inner 
- "'^product is:- : ? - : x^:^.*-. . \ ■■ . . - . 

: : vo;k dinner Prodiict( k)- = " Rea£l (Left (k) ) *Real( Right (k) ) + 

10 imag ( Lef t ( k )- ) * Imag ( Right < k ) ^ ^ - ■ 

- - .'-and;;±s- implemented as .. slipvm in w FIG;' 2. The- operation flow 
■j J in FIG. 2i is repeated for each^f requency 'bin. \ -Oxl the same 

: FIG.. 2, -.this sum- of . magnitude' siqiiarec -is calculated as: 

Magnitude^ Squareid Sum(k) = : 'ReaQ. : <Left (k) )' 2 -' + 
15 Real(Right(k) ) 2 + Imag ( Lef t(k) ) 2 + Imag( Right (k) ) 2 . 

<An inner- product- &nd magnitude ^qiiare^ sum are 
calculated for each { frequency biri forming " two 'frequency 
domain vectors. The inner product and "magnitude squared 
sum vectors are then passed to the beamf ormer - gain 
20 „ operation 115. This gain operation -uses the tW vectors 
to calculate a? gaiii : ' p£r f r^quendy bi ; h . : " " " ? ' r • - : - 

The beamf ormer gain operation Z I15 Hxt'-FTGr' lir^Ls shown 
in detail in FIG, 3. The inner product and magnitude 
squared sum for ^acfe v bih j; are smbothed' temporally using one 
25 pole filters 301 and 302 in FIG. 3. The output of 302 
(the smoothed "stilts of ma gnitude squarWdj- wili f brm' the 
r total power estimate used' -in calculating ^becon 1 intensity. 
The ratio- of the 'temporally smoothed'*" inne^ ^prbdiict and 
magnitude squared -fetoft i©*:then— g^neratfcd by- operation 303. 
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This, ratio is the preliminary ; j-direq^p.n estimate "d M 
.equivalent to.:. •■ - - : . 

d ,= Average {Mag Left < k) Mag Right (k) 2 qos [Angle 
Left(k) - z Ang^e^ Right (k)l) J Average .{Mag Sq Left + 
5 Mag Sq Right) : ■ .-. -.<:---;;-. - a 

The ratio, or d estimate, is a function which equals 
.5 when the Angle Left = Angle Right and when Mag Left = 
\ . Mag "Right ;; that': ijs> when the values, : f or frequency bin k 

are the same in both rthe: left.;: and right channels , As /the 
10 magnitude or phase angles differ, the function tends 
/ :c;. : tow^rjd-zero, and: goes negative for;; ;P 1/2 < Angle :Diff < 
~ r : ; 7 3PI/2 * . .For di; negative * djis^forced: to zero in ^operation 
: fc) 304* It-is isignif ieant:;.tbafc, j th'e d -estimate us^a both 

phase angle and magnitude differences, thus incorporating 
15 maximum -information in £.he ^ estimate; .-; •; 

The direction estimate d is then passed through a 
£ reguenqyydependent .--aqnlJ.jaea^aSy- Qpe^atipn .305 which 
: raise,s,.d to higher .-povferp at: lower frequencies to generate 
£.,;; tl * e f ;f„ n ^l . direct -V95 estimate vector D... For example, for 
20 ,4r_equ^ncies :> E r under 500Hz* D = d 8 . The effect is to cause 
\ : v ^ke < ?4^ e ?tiQn estimate tp^tend towards zero more rapidly 
at low frequencies. , This is-desirable since the: wave 
lengths are longer at low frequencies and so the angle 
.differences ^observed, .are smaller. -< . 

25 The generation pf- the beam : intensity vector is 

, r carried -out in operation 316 of_.Fig> 3, and requires an 
s + U: ^-PPV^ R°yi er *y ect : 0 J- The : input _power^ vector used depends 
'^'-i-jr,:^ 1 ?* PP e F& t iP5.z™R&&-' j eoperating,Jtfode One, the smoothed 

:i i^Siw-tude- squared sum, vector from single pole low pass 
3 9. ; c. :f 'Alper. 30 ? is .used j£pr beson intensity calculation. In 
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operating Mode ;, Tw6 ; : ; a ratio between online power and 
- "< - biased total s power is used. 

: - r ■ v The determiriatiou "of the bnriiie power begins by 
: " - ' ■ summing thfe lef t 'and ' right frequency domain signals at 
5- J : s morning operation : : 308 ; The v sum at '"each freguency is 

muitiplde'd by the "direction estimate D in operation 309. 
The product ~i& sqwkted iii* "operation 3ib tiieh smoothed in 
one-pole lowpass filter 312. The resulting online power 
: - corresponds the ; sitioothfed magriitud6 L 's^aire J * of the fully 
•10 be^onf ormed suit? of left ^ and rx^ht channel ^ which" is a 
1 - iheasiire ; oF : " online power, as opposed €o the original 
'smoothed magnitude square' vector "which" cot responds to 
total power . - cq.-.- / • "■■ - - 

• :■ The bne-pole sm<^thirig~ filters 30^ ind 312 have two 
• 15 r coefficients each : : Air attack coefficient and a release 
coefficient. If the input to ' the smoothing filters is 
increasing, th£n the att^crk Coefficient is usech *~lf it is 
decreasing, then the release coefficient is used. This 
implements the attack- and-r el ease time ' constants for beam 
20 intensity. These ^ttack-and-release time constants are 

adjusted by changing the littkck ; u coef icieiit and tW release 
coefficient in smoothing filters 302 and 312 . 

- The online pb^er r fbf'fe^ch frequency bin'is 'tHe 

numerator foir the^ rktlo" cal&ulSteii in operation 314 . The 

25 total power iS available f Saih'the^ ^ihgle pole, low' pass 

filter 302 • A small"' bias value "from register 311 is added 
to the total power by summing operation 313. The bias 
value is big enough cio guarantee "that when the online 
power and total power are both very small, 1 the resulting 

30 ratio from operation 314 will tend towards zero. 
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In operating Mode Twp, this ^r^t^^is : used : t-o : . 
calculate beam intensity. } The operating -mode-selector 315 
selects between total power (Mode One), and the ratio of 
online power to biased total ; power . (Mpde Two) as the input 
5 r ^y ector ^ hi £h is sent pn to the .beam intensity- operation 
316 . The operating^mode selection, da. controlled, by the 
user ( i . e . , r the Rearing . aid ,,wearer ) to- select;, the , correct 
operating mode for. a. giy^n. sounjd r: enyironment 
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15 



20 



t --$r\-; o T £-f-= ;^ eai1 5 ■'^ n ^J^f^7^SR B F.^P^9 JX . is detailed, in .Fig. 4. 

b ^^P intensity, vectoj:. .will, ,be . generated in T - P subbands , 
,wher^..P is, smaller „t&an ^the ^number, of . -frequency- bins n. A 
; pubband^is. a cqiytigupys.. group, of. .frequency- bins. . : .The 
subbands are non-overlapping and adjacent .... . .A,* typical 

value for P is 3 which divides the frequency range into : 
three . ad j ^cent brands for., example , . ,0-1 ,,0.0 OH z 1,000- 
. f 3 ,000Hz, 3,000-20,000^... ,,Ia. the simplest form- of the beam 

.^tensity, y^ct^ir^ ?. i^,one; i.e.., the beam intensity 
v factor is the same. foj ,ttie._entire .sound .spectrm. - 

., , T ?_9®P erate the . £eam. intensity vector, the. first 
; operation 40}. in FIG. 4 t surr|s, 7 for each subband, : the input 
power vector from mode selector, 315. (FIG. 3) across all 
the frequency bins in. tli^ sjubband... The input -to operation 
401 of Fig. 4 is an N point frequency domain power vector, 
ou ^P u | : f :i?. f a ?^pP int • f r^ency domain subband power 
vector • ^ , Every , s^s eg^ent., opera^ipn. in. Fig . 4 . is then 
. , ca . rri ®d ou€ pri . each .poisfc of. the^P point vector until the 
"beam^ intensity expansion operation 408 of Fig.. 4. 
, . { Operation 408 converts . the vector, f rom a P point to an N 
^ point vector where Je very ^ppi$jt in each subband . has the 
30 , r same value* 

The subband power vector values are normalized in 
operation 402 of Fig. 4. The number of left shifts 



25 
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required -ta^ ref lebtsT the logarithm 

-7 .:to. the base two oi-the fractional value's, 1 forms the 

integer : part -or the P point power index vector- The 
i. fractional;, part : of -the -power index vectdr is made up of 
5 the: normalized: power vector values shifted left one 
t,: additional, time- by' Spefation^^OS-" o£ Fig/ 4 with the sign 

bit. and ^overf ldw bits masked. " - 

< The power- index vector is us^d^to generate a P point 
:,; :r vector of beafti intensity : %a!lues : tHrotigh a : linear iy ' : 
10 — /interpolated table lookup -operation? The integer A "part of 

each value in- the Power Ihdek vector used assail index 
^ ■, into the Beam Intensity ^Table --404. -of :T Fxg; 4 . r The " output 
of the Beam Intensity- Table :; is the Araiue" at 'the 'index 
offset into the table and the value at the index-1 offset 
15 intb^ the table, ri The fraction part of r: th£ iiidex is used 'to 

linearly " interpolate ' between 'these *cofisecxitiv4 : table 

• '--.^ value's 4 " using- multiply djperktxdns 4 05- aid '406 kridi ^summing 
■ operation 407 of W Tbe 1 result&§ 'inte^M^ed value 

-is the Beam fhtensity"^ is *6n4 Beam 

10 1 Intensity - value : for ev^ry- ent vec€or 
• corresponding to "one beam 1 intensity 1 "for ''each subband. 

' The Beam In tensity ^Table implements "a ^nttion of 
power, as shown in Fig^> : 5V ;; -^ is 
r;e. designed in -such a way * that y 'at iiormkr onliW sj>eWch ~ : ~ 
15 levels, th6 beani intehs r xty : %al*ue*- ±s very r nieariy and, 
in th6 absence" bf~^bn*lihe- sjfe'eSli "(in' J the % ca¥e of Mbde Two 
operation) or of any speech' (in the case of ' Mode L 6he 
operation), then the beam intensity value is nearly zero. 

In' FIG, 5, : the -table- butputs'-a^Val'ue'-" of beiit' " 
0 intensity .ibetVeW^4W r and :: 0\"b~ oh tfie vertical 0 asd^ 

depending on the -power index value " input on the 'horizontal 
axis* The poWr- ^riax Corresponds to the hiimbeV of left 
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shifts, in, /the, normalization- proce£-^ c req:uired Lta-move the 
first. "1" in the power binary data ; yQrd *to. the left most 
value position. . The normalisation: process is^.u"sed to 
conyert the r^nge .of , power. :; variatcioiis ^into a rlogarithmic 
5 scale. L Each left ..shift in ; t;he„powervcnormalizatian 

corresponds to 3 c db change -in, t power > -..If .there" .are 23 
value bits (24 bit word, with 23, yalue bits ;pius a sign 
bit) in the data word from summation 401 (FIG. 4), there 
; s a?e. 2 3 T possible shifts eg^iyale^t .to a, power range of 69 
10 ? Th }? s ? th § -P. 0 ^ e ^. AQd^Xv varies .from -2 3. at.- the left to 0 

^ : ; T at, the .right in.-F^IGc- 5 r; .^n4 :H [tfee lower values of., power - . 

:.i £P de ? F?£ re ? P OI * d . "1*9 < higher input powers. 3 For hxgh powers, 
- . . :. ttie i be ?^ f ntensity ^al^ie^s * near.uni^ for; low powers 

the ^beam- i^te^ity v&lu^ ris - near zero . ; „^ - ?x 

1 §-r - ^? ak ; P?^^ s r*9^ v?f^ beam intensity ; transition' 

fl-i 3 ^^- a3 f® ?yP^J ca ^ 1 y E^^-^o^r-i^ 10 as 

.5 i^S*? 1 ^£ F IQ.. ^ 5 is 

?i &ft,^ at a place where 

be^mf orprnir^g pp^r^tipn^ is, reasonably -s table; is-;e. n } slight 
?° : - changes i^ c po 3 wer do T no£.^ : c^us.e : ,the,- T beamf ormer to < jitter on 
. _ ^J 10 * ° f f/ja jA n?P w ®K. > n i ^^ n 9 e of 2-5 is about right 

for the upper breakpoint. The lower breakpoint is 
f£ ele J^ transition between 

*l .^A^ If the transition is not 

25 iJ9£/^PP^^;r^ abruptly snap between 

p$fx§f oiTn^ng^and non-b^mf ojnrdngy:^ Ar dif f erence of /5-9 in 
; BrW^ ^$5* ! h ?tw&en A^p^rv aad : lower; breakpoints provide a 
^ sufficiently^ smooth transition*.- * - - : 

* > . a : * • . . t • ' .""^ , o ,v/.;.C r* . * r* ~' J i . ^ , ■ * * 

In FIG. 4, operation 408 expands the beam intensity 
30 v^c^qx., , ^e- .direction is N points long, 

w ££k °i n -^ £ pr ^ery : freguency, bir* -(i.e. , 128 points) . 

vcc:*/:.?^? t> ean V intqnsity_ f vector -.is ^prter, P poirits. A ; with one 

SP*?**? per . subband:-:( e.^ P«=3 ^su^ands ; ): % The beam::. 
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_ . intensity ^vector ..is expanded . in length to ..equal the length 
of P.,^ ^Pe^tipn 40,8. ,. This expansion involves repeating 
the ^^band M BS ^ intensity .for every frequency bin in the 
s ^ ba ^*\ The -.^^P^nded beam intensity vector, is then 
, 5 / V c .?^ in i e ^ wit i h the^. direction estimate vector D- to form the 
beainformer gain vector as^ _ shown „ in FIG, ,3. 

In FIG. 3, each element of the beam intensity vector 
is multiplied .agains pf the 

* direction estimate vector P at operation,, 306 . At-the same 
• ^ i " ie ,' on f A s - sub tracted froip each element of ,;>the beam 

intensity vector, and the, result is r , added -by operation 307 
to the product froni operation 3Q6 ; . Accordingly, the beam 
gain vector values can be determined per the following 
formula: . _ _ 

15 G = D*B 4 + *(1-B) 

where: „ *■ ? —v--. : , / y.h '■■ ■ ^ ~ 

G = beamf ormer gain . ; p 7 .■ . 
D = direction estimate 
. B = beam .intensity.^ - : , ^ ^ < : t 

20 When the beam intensity .B for va. particular .frequency 

approaches one, then the beamf ormer-, gain G- for. that 
frequency will follow the direction estimate D for that 
frequency. As the beajn ^tia^sijty^ B. -£or i: -aj. frequency 
approaches zero, the beamf ormer gain^.jG for v that c frequency 

25 approaches unity , with direction, estiinate yeGtor :> D :} playing 
a smaller and smaller role. N points of , Beamf priner Gain G 
are generated, one for every point in the N point 
direction estimate „ and expanded beam intensity vectors. 

In FIG . 1 , . the Jbeamf orming., .gain -.is used -by c ;: -^ r i 
30 multipliers 116 and 117 to scale (amplify or attenuate 

depending on the gain value) the original left and right 
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ear frequency domain signals. The left and right ear 
noise-reduced frequency domain signals are then [inverse 
"transformed at FPTs 118 and 121" ''"tfHe " resulting time " 
domain segments are windowed With a* "sine window, and 2:1 
> overlap-added to generatV 'k left and right "signal" from 

window operations 119-' and _122. ""The left arid "right signals 
are then passed through dfeemp&asis "kilters" 120, 123 to 
produce the stereo output signal. 



- ^ile 7 ^ "the invention has 

■^been shown : and "described , v it "Will Be appreciated by onp 
Skilled ° iri : the *art ; ; 'that "a number of' further variations* or 
- modifications 5 ftiay be^AiLde^Witfiout departing from the 
: Spirit aiJd' scope of • my°ihVSxitioh^ 
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■CLAIMS: ir. , - W 



1 . Signal discrimination app'aratlus' Responsive to an 
input signal for selectively enhancing ah 'iftput u signal or 
a desired signal embedded in the input signal, said 
apparatus comprising:!^; -:H . \-« . - :! . c 

- means for . detecting power; d^cihe desired- s ignal and 
power in the input signal, 



. oceans- responsive^ to 6aid- detecting" means : *f or 
generating a power value; s-^r.O * r * " r ; ' 

, ; sep^ating .means, xesponsive to * the f>6wer value for 
separating the .desired signal : from the 'input -signal when 
the power value- -is /high; rand:; • r'\ \ :1 

~ c * ^said separating -m^ans.not separating, the desired 
signal, from, the input, :aignal when* the power valii£ is low. 

2. The signal discrimination apparatus- of claim 1 
wherein said generating means is responsive to the power 
in the input signal and provides a power value directly 
proportional to the power in the input signal. 
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3 ' Tiie ' sl-giiki' : '*disci:imination' apparatus of claim 2 
wherein said : separating" means comprises: 

- : ;i - means responsive to the power value for generating an 
-intensity value having a first value for high power values 
5- and' a second value fbt low pdwer values; 

means responsive to said first intensity value for 
; - ; ; ^enhancing the desired Signal and ; for " diminishing all other 
*' 1 signals in the input' signal; and" " * ! ' 

means responsive to the second intensity value for 
enhancing the entire 1 input' signal uriiiormly. 1 

4. The signal discrimination apparatus of claim 1 
wherein said generating means comprises : 

means responsive to the power in the desired signal 
and the power in the input signal for providing a power 
ratio directly proportional to ratio of the power in the 
desired signal to the power in the input signal. 



10 



WO 95/20305 PCT/US95/00895 

. 21 

5. The signal discrimination .apparatus^ of . -claim 3 
wherein said separating means comprises,: . ~ 

means responsive to the powjex ratio, for , generating an 
intensity value having^ a . fir,st value .when the- power ratio 
i approaches one and a second yja-lug when , the power, ratio 
approaches zero ; 

means responsive to^§aid f< first?., intensity. v } alue for 
enhancing the desired signal r and for diminishing, all other 
signals in the input signal; and 

means rj=sspon$ive ,%o „t:.lie B second intensity value for 
enhancing the entire input signal uniformly. 
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~ 5-0 ^selebtivef signal processing in a "radiant energy 
signal processing apparatus for processing signals 
received by a plurality of sensors oriented in a 
predetermined' viewing direction, said apparatus 
5 "i doiftprisihg: - z 

, \ beamforming niearis responsive* to the signals from the 
plurality of sensors for separating online signals 
arriving at the sensors in a direction near the viewing 
< - -'-"direction from Orf-line signals arriving from other 
10 - - directions; .- rt - -~ " 

monitoring means for monitoring all of .the signals 
and determining " ef Combined strength for all signals and an 
online strength for the online signals.; and 

enabling means responsive to signal strength for 
15 enabling said beaiaf orming mean? when the signal strength 

is high and for inhibit ing said beamf orming means when the 
signal strength is low • 1 ^ ^ _ .. . 

7. The apparatus of claim 6 wherein said monitoring 
means comprises : ' - - - : * 

medris f or' suihmihg the power of ^ "all signals to, 
generate a power index; ^arid 



means responsive to the power index for providing a 
beam intensity indicative of the combined strength for all 
signals, said beam intensity being high when the combined 
strength is high and being low when the combined strength 
is low. 
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8. The apparatus of claim ? . where^ said enabling means 

•compr is e s ":' * " ' ■ 

means resporis ive ' to high ]b? t w int ens i ty, f Q r 
amplifying : the online signal and of f -line signals by a 
3 gain dependent on the direction of arrival of the signals 
_ whereby the online signals are enhanced , and the off-line 
•signal's are attenuated;' and ^ .!.'.'.'! \. ' ' 

™ e 5 ns r ^P^ B ^'^^ov^b^ .^ e nsi±y for amplifying 
online and off-line signals' uniformly whereby "al^ signals 
are enhanced equally. 



9 ', r ' Th ?- fP?*5**?^'of ; claim ei^d^ iji Addition: c ,.,., 

means for transforming the online and off-line 
signals into frequency components; 



. "^f^..??* .fj^^^ . al V signal" components 

with one or *iwre^freq^enc^"'bM4s;;to:px9iiuc.e a 'power index 
for each frequency band; and 

- means 'respoxxlive to the power ' in£ejc in "each frequency 
band for providing a beam intensity indicative of the 
COinbi ^ ed , Btren ^ h , f or r ^i ^igimls .within, each frequency 
band, said beam intensity* beiV^ high when the combined 
strength is high and being low "when the combined strength 
is low. 
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' lOV The apparatius of" claim 9 wherein~ ; saidL enabling means 
comprises : 

" 'means responsive "to 'high beam intensity „f or each 
frequency band^ fdr amplifying the online ^signal and off - 
5 ' line signal f regueiicy' components "within the band by a gain 
J ? dependent on the direction of Arrival of the signal 
Components Whereby "tfie online signal components are 
enhanced and the off-line signal components are 
^ attenuated; and ' 



means responsive' to low beam intensity for each 
frequency band for amplifying online and off-line signal 
commorients wi'thiri "the Band uniformly whereby ail signals 
are enhanced equally. 

11. The apparatus of claim" 6 wherein said monitoring 
means comprises: 

means for ^surnihirig the power of all signais; 

means for "summing the power of online signals; 

means for taking the ratio of the online signal power 
to all signal power 'and ^producing a power index indicative 
of the ratio;" and " *' *-*""■ 

means responsive to the power index for providing a 
beam intensity indicative of the relative strength of the 
onlink signal's to" all signals /. said beam intensity being 
high as the ratio approaches one and being low as the 
ratio approaches ^erd." " u ~ " : 
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12. The apparatus of claim 11 wherein said enabling means 

comprises : 

means responsive to high beam intensity for 
"amplifying the online signal components .and of f -line 
5 signal components by a gain dependent . on the direction of 
^'arrival of "the signals whereby, the ..online signals are 
enhanced ^and the off-line signals _are attenuated; and 

means responsive to low beam t intensity for .amplifying 
online and off-line signal components uniformly whereby 
all signals are enhanced equal ly. 

13 . The apparatus .of claim 6 ^and * in r addition 

means for transforming the online and off-line 
signals into frequency components;^ 

means for summing the power of all signal components 
5 within one^ or more frequency bands; 

means for summing the power of all online signal 
components within one* or more frequency bands ; 

~ means ior taking the jra/tio of. the online signal power 

to all"" signal priiier in each frequency band ^nd producing a 
power index indicative of the ratio in each frequency 
band ; and 



means responsive, to the. power index .for providing a 

beam intensity indicative of the relative strength in each 

er_,- ^ & T ^o... • n- aj.-^x v. »kc fi^ri,: try" a v ; ? 

frequency band of the online. ^signal components to all 

15 signal components, said beam intensity being high when as 

the ratio approaches one and being low as the ratio 

approaches zero. 
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X f .: . ?PJ?^?^^? ^pf .claiin 13 wherein said- enabling 

comprises: . 



means 



means responsive, .to Jiigh beam intensity for - v . 
amplifying the online signal components and off-line 
si^al components by a ,gcLin dependent ..on the : , direct ion of 
?5^ ival of the signals^ whereby ,£h$.. online signals : are 
enhanced and the t :<?ff rA4^ e ,sigrials. .are- attenuated ; and 

means responsive to low beam intensity for amplifying 
fJP-M- 1 * 6 ^ nci of f n -^ ■ J 5 ^^-^! .components .uniformly whereby- 
all signal s are enhanced equal ly ... ^ . ... , 
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15. In a binaural hearing aid, beamf orming apparatus for 
reducing -rioise in the ' souhd" signal provided by the hearing 
aid to a user, said hearing aid processing left and right 
frequency domain vectors corresponding to left and right 
5 audib signals, said beamf o fining apparatus comprising: 

means responsive to tile ; le£t L ahd right frequency 
domain vectors for generating V diredtxon estimate vector 
• ^ indicatiirg -a* direction -ah ^iidio ^idfhal is coming 1 from 
relative to the line of sight of the hearing aid user; 

■ ; irteans : respbfrsive : to t¥6*i^ft a ahd rigrht" ^frequency 
domain vectors for generatihg'a beTam intensity vector 
indicating strength of the sound arriving at the hearing 
aid wearer; 



means for scaling the direction estimate vector with 
15 the beam intensity vector to produce a beam gain vector, 

said beam gain vector is similar to the direction estimate 
vector for high beam intensity strength and approaches a 
uniform value irrespective of the direction estimate 
vector as the strength of the beam intensity vector 
20 decreases; and 

means for amplifying the right and left sound 
frequency domain vectors with the beam gain vector whereby 
for high beam intensity strength the left and right 
signals are beamf ormed and as the beam intensity strength 
25 decreases the beamforming of the left and right signals 
decreases until for low beam intensity strength there is 
no beamforming. 

16. The apparatus of claim 15 wherein said beam intensity 
vector is a function of the power of the sum of the left 
and right frequency domain vectors. 
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17. The apparatus of claim 15 wherein said beam intensity 
vector is a function of the ratio between power of the sum 
,9^ the ^eft right frequency domain vectors after 

: beMfpming ; to the power of the sum- of - the left and right 
5: frequency domain vectors before beamf orming. 
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